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&^//s S Si£T^ X'J XA J: 0 S I - S S SST/l' 
a" '.J X AC£> 1 -»-C ilA HCiSjIT h IZ i> mfo b . I C7) 

2 ^.rnmz x h its r? x t «i , h t "fm 

\)XMZ&rt& 3>t-*X h^ftJ^SU-rX hcoiHlfWi 

mL?t:%&. SSS^(i (K-f-1 ) \*lX<h£--K. S I 
- S S SffitiKO-CftS S I — S S S^<7)=7>-r^rX 
h ^^IfX h t ± . fiBfef^) S S S jfeOS ^17JSB (£ 
KMJ: 0^^fflt^)^*\ CiKif^ggBIJ: 07 7X 




s^^(*M^ftSM^^-r^ >: tbiaag/j ^5 v i- 

4^. *ISS»K!»^S I - SSS£»M 

cn&WTfl- J 0 XA S: ffl i -^^2:^^ T 4 .2 1 
S S S^cOB^^^iiJtzfc ^xm\< > ki\&$L- 

^(iftf)j. *^(z, imcvsssmzx&mm-K 
fiicoftwir* h ictt^s kw)Si-ss smzx 

h, fIL. B#P H ^^>^JnxN(i. HrF^lSr/i^ijx 

r ?5*fl^carF5ii^ .1 > /^^ . ^T^r/t =r <j xa 

a.) ax h<7.){ J/u^)— 352: £^>S^:'( tT'^^ , figoT . S 

1 - S S S^)[#r B TO^^)^fiJ^)5etIPax hA^B.lHi:'^ 

x &mmzj:td£. s t - s s s^(±. miztitz 2 6 

2 0 mis^)is*(?:#s^(cfoc s s sffij: *m > 

[ 0 0 23] tztt. S I — S S Sffi^m^rltSti^M 

t lx ^ . hm«)M3.x b *mm^z>m$tmmt 

•^fr^r^sfpw (si-sssaffl) ^ii^o m-f 
x . sssMysi-sss a^^) =? x h nmfi^i 
i&x\fo&, m*-i£. mm^m^zmixiw^s^ 

ZixbffitzZ: 2 ^(/Amiz^KXC&^^xmm^ 

•tttfo-h. ftm Zixfzffitt 2 ^Amj-j^m. 1 izh 

iia-b-y h (A) ftMz-t&fr. ±ffi-t: 
■y N ( A ) mi ( B ) $)MZ-T?^jy\ IMt^t^t y 
h (A) . (B) M(C) >LT y oJ:vv. 
[ 0 0 2 4 ] f;t»)SS S&lCfei^Tti:. -fc h 

( c ) icm-th imnm-s-' <yx-x *wi§7g-r& .1 1 

M^^)^i rff^/AftS , s 1 ~ s s saxi i ^S'JC: J; 

h"^ipmmxhh -z t ^msru> z t . -t ••/ 

b (C) (C^/j^fr:^>^llJy^ 
tz*b<7)S I - S S Si£^7^ 3 > (C(±nT^)i>^^ 

LXff L- 1 *f iJSSrftSW S ... 
( 2 ) '^IfJ-^ £3>-^x h^ra) £Rf5 
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=? >--r*x b^m^mmm*:&mm-3-6, 

[0025] i£RS:gTr£j£J±. 2o«L 
#Sil^-^Jf£m^S I — S S S^)THd'[)X14,i 

[00 26] <s. vm^mtmm* m Lmm>ftw\ 
!tmzmm *ta>^m;\i?\h &m-k?>itmzm lxi± . 

a. (mm->ti><7M?t (6&£$ffl9. i o. Rin 2 > 

-c & m&frlfi 5: 7 :? X 9 ft L T . -r - ^ Tklf 



I 0 0 2 7] m2<r>*Tis s >ii, mM^- f ^im.^ 

mmizmrk\w-& z t x-fozw. -jmvywmzimm 
m^mt^h. m^x. mm%itmmwmbx$> 

coitm.x\ft*) . mm^^Aimzn^h m^Mm^m^ 

Q (6 I 6"**) 
= E [ 1 ogp ( yi r 
= £ P (s, r I y t T 

= 1 p ( Sl T j y/ 



*BrC 7 W 1 5 in I X ffiffl $ tlX * 

oizmittb i>cr>£EJbti&w. mmizio^xmmtx 

X t i ^ , ffi L , ^WlitmmcOM^fVj:^i imz . 
mhm^m^crym^t^ioixh S I - S S SWiZti^X 

l 0 0 2 S 3 C£OBiat*«"Sf»^^W^{±. *KJ: 

(Zfo&mmM-M±m ( E x p ectat i o n M a 
x i z at i o n : EM) (OT. EM 

r /l 3- [} xa > i » , ) ^wtt: ( um-xm 13 1 A. 

P . E) e in p s t e r et a 1 . . "M a x i in n 
i n L i k e 1 i h o o d f r o n i I t t c o m v "> 1 e 
t e D a, t:. a v i a. t li e E M A 1 s o r i. t 
hia" , J <:> u r n a 1 <:> f t h e Pi o y a 1 
S t a t i s t i c a 1 S o c i e t y . V <;> 1 . 3 
7. No. 1. pp. 1-38, 1 977-^1 rfilfflL- 

^^ii^s^sra^ft-r^^iim^, em 

itm?)mhnzm£ix<< , z<rmm&* mttt. hm 

r±.-^-c^'r-r.t* i "cs, zzx\ Ee iT , \ • i j± 
y^x-^/^ ( P ) (cM^^^f^JS^ffl^fgi:--^^ . 

[ 0 0 2 9 ] 

[11 ] Q I =E^ ([0 I 1 OSP (v"! 1 , 

I .\y. 6^) I 

[ 0 0 3 0 3 - »7;>%&-C-L . SSil-r-.^ L 
( 6 ) - 1 o r< p ( y ! T I 6 ) ?)1tmzim{ti^z_Kc 
i *i , 

[ 0 0 3 1 3 

[S2 3 Q (0 \ 6^) (8^ I ^ tP) ) = L 
(6) (^^) 

[ 0 0 3 2 3 HMMtCftt+^^fTr? }^^>(Ste(C J; 

S , 

[ 0 0 3 3 ] 
[13 3 



Si 1 I 9) I yi T , 0 CpJ ] 

0 (P) ) ! OgP ( yi r , S: 1 I 0) 



[ 00 34 3 ZZX\ 



Z [1 ogp (y, | s ti 6 K[t} ) 

Si f t 

+ 1 O g P (Si I S t-i. 0b(i>) ] 

= 22r, (s) logp (y, I s, <9au>) 
s t 

+ Z 2g t (s, s' ) Jogp (s t = s I s,-i = s' , 0B<.>) 
s , s ' t 

[St 4 3 r t ( s ) = P { s L =s I v'! 1 , 
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[3£5]£ t (s, s' )=p(s t =s. s t .!=s" 
I y, 1 , ) 

[0035] WL3<r>mmt. &ms-m0>9m/*7x- 
<?>x*$> h ... tnz x -? x . mm s nfzitm^mua 

I 0 0 3 6 ] lf(C. WMftmeoHMMgj&lzmi-X . #8 
ilir, ( s ) &V- =, ( s . s ' ) ^T<7.)s=FS*tC 



■Sttfl-SMSQ ( 6> I # w ) J±. s * s * izmFf& 

s iBLiswm s /^Jti ij s <c*hr © mm £ * -utsmtis 

[0037] 
[«6 ] 



G (S) 

= S En (s) logp (y, I s, 0a (i >) 
s = so. Si t 

-Sr. (s*) log p (y, I s *, 0 A (.o) 
t 

+ £ £ S €. (s, s') I o g a,,- 

S — So, Si S —So, Si t 

— E£,(s *, s *) 1 oga a * s * 
t 



mi] 



G (S) 

= 2 N i (s)logp(y, I s, 0 A (.))-Ni(s *)logp(y. I s*J A(l „) 

So, Si 

+ 2 2 N 2 (s, s')loga 99 - -N 2 (s*,s*) loga 8 , 9 . 

S — S o j S i S — S o » Si 

[0038]::?. a^ = p (st=sls t .i= N a (s. s' ) =Z« t (s, s') 



i o o 3 9 J 
ess 3 



[«9] 



N x (s) = 2r t (s) 
t 



i o o 4 o ] m$m-m>i7*—?<?:>Mz£&*mi£. 1:1 

I 0 0 4 13 
(11 0 3 



Go (S) 

= 2 Nx(s)logp(y t I s, 0ao)-Ni(s *)iogp(y, I s *. 0 A£l >) 

S=Si, s 2 

M 

= 0. 5 [2 [N x (s*) logo. 2 (s*) -Ni (so) loga. 2 (s 0 ) 
m= 1 

-Nt <s,) loga. 2 ( Sl > ] 

-Ni (s *) log [1+ INi (s,) Ni (si) I /Ni (s *) 3 
M 

• 2 (jxo (so) -u- (si) ) 2 /a D z <s *) ] ] 
m= 1 

[00423 flU J: oTISES Ltf»5 ( fcBfcaSK 14 1 T. W. A n ders o n . 

iu Tfl-^^miiM^TC^^ h;l--^*r»^L^)-h "A n I n t r o d u c t i o n t o Mu 1 t i 

[fif£tZ> , Z<rmm^:MWrmMi. it£M$M 1 0 (ZM v a riate S t a tistic a 1 A n a 1 y 

MZiXtz. &-&*tXt2^mt &frffr<7)1tmm* mm sis", J.Wile y & Sons, Ne w Y 
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[0043] 

iai 1 1 



o r k . 1 984^1 com 1 0 jffi 3 Jf SOSSSUcgO' 

= Go (S) -N 2 (s*. s*) loga^-f-Nz ( s 0 , s 0 ) loga sfe0 
H-N 2 ( s 0 . 1 o.^ a sls0 +N 2 ( s x . los a shfl 

= Go ( S ) — N 2 ( s * . s * ) 1 os a^ + N, ( s 0 , s 0 ) 1 og a. te0 
+ ( N t ( s 0 ) -N 2 ( s 0 , s 0 ) ) log ( 1 - a sOs0 ) -hN 2 ( s^ log a slsl 



[00441IU 0.8.1*14 1 1 lz J: oTf#^tSM«l£ 

. c o 0 4 5] m i oms 1 1 cr^mi. mmtm&o 
(-fc t xmmitmzm'J< ^m^mmzmm s i ist 

«1 0 At/ft 1 lfcL *IU(caLiIL^./-Kr^7E^ 
M£fC tss S jrC'GWfl *ix & jb» ( flG*:saK 1 tf« 

( i ) ) ttemc&m&zHm ix\- z<w& 

a, s i - s s si&nmmn-fffiimz u k umm^s 

x\h n . m-im^-Tz z t \;zmm-z>im.cr>m 

wx{$?&\ tlx. ^W7-?<?:)itmwmutzmi&'3 

[ o o 4 6 ] ftmizj: h HMM^mzt-jifiAm^tm. r 

t ( s ) RU'St < s , s ' ) <D«EJi. .Xt'JS*^ 

^-ftSrSHc L-f ^ >S . ^ 1 0 its *trt(e . 

9 tmz x nmmzntz ) ztm ix&\simiz$t*£zm 

l 0 0 46] <4. r? yr*X h^pj-ifliJ^Sft^J^-^ 
-*>fM*Rf*OS S S^ig^ai-fray? yX9 \) v 

7 corn zf o XAXch h *&> . miimm^yimiz^ift 

1 L, Bre i ni an et a 1 . , "C 1 a s s i 
f i c a t i o n a. n d R egression T r 
e e s " , W a cl s w <:> r t h I n t e r n a t i o 
n a 1 G roup. 1984* i ) /jM^J@jg£ 

h Z t ifiX+$ h , fklZMz J: & IStMcfcl -t-SfflH 
X*^Y*^ffl^S3t4^BIRYh=f (X) $-15 



mi xfohw^zwnw^b nm\h . ^*p^f 

Y 5:il^(c^ ilJ-T S J: ») . ^wim am 

Scm 16 1 L . B a h 1 et a 1 . , "A t r e 
e-based s t a. t i s t i c a I I an a* u 
a s e ni o cl e 1 f o r n a t u r a 1 1 a n 
K u a .sc e s p e e c hi r e c <^ n i t i <:> 
n " . IEEE T r a n s a c t i <^ ri s o n A 
c o u s t i c Spee c h . a n cl S i & n a 1 
F ) r o c e s s i n , Vol. 37. No. 7 , p 

p . i o oi-i o o s . 19 s 9* i #33, ) xmm 

X) =P (y I f (X) ) ^ti^-t^^icftfflwr^ 

, m^mmwmt. ^mm <mti£. ijmsrM 
10. lifps, ) {ztmhmmm? yx?\)> ye?) 
mmiznfc i x v /-^> . mmmz x h m\-K : &*z z 

[ 0 0 4 7] ^jEtKJc J; SISItXt.±— ffitci * :j *SfJ7 y 

x9 \) v?\:zm^hmmmrrT\3-^\i_ bik(crk-^ 

h, .Z<T)TtVd[yXM£. Wnm.^h^Xcr)^^a) 

m. -t^x^m^mkx (x?Mm) . ac^sx± 

zttfW£Xtt>& , mmzmxfrmj ^->x^f% 
. -rx b -tK ^ > v< ^ i; — Jtiij ( xi.i 2 Km ) 2 

ix a. m^^m<t^-x.x^6, mz, vmxmiT 

1 F* . A . C l*i o u . " O p t i m a 1 p a r t i t i 
<^ n i n s f o r c 1 a s s i f i <:: a t i o n 
a n cl regression trees", I E E E 

T r a i"i s a c t ions o n P a t. t e r n A 
n a. 1 y sis a n d M a c h i n e Intel 

1 i'gence, Vol. 13. No. 4 . p p . 34 
0-354. 1 99 1$43i (ZtoWX . > a $ 

biz—m's&wm ( j ^ 2Rvm* 2 ) (ztw&mMr 
mmmrfu a'ox^ffimix , > v 3 *?omv 
^ V xut . mz^ < <ry*mt<r) m mmmzn i x mm 
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JtfflLT M>2<7)i&£-K(i. .1 o Ufc/t 

5 ) j: *) t * bizm&tf&VK Mz.n'gmzr/i-zmm 

~tb H MiicO^PcllKc^V Xli . Xti^PMfllST&I 
Ur&J) T'&^iefcttfrSr (ag&mo) »C1»R3*iXh 

h , 3 >t- .x i- -fi&wmtuzn ix i> . xc7:)fi{,±#^ 

?<>IX°$> ') . B#HT14N = 2 6fSmJ - te-.> 

m^yvmmizmw.Lxt-5 n . ^tmnM-ftm**® 
mnz*r—*-*z,t&><?)T)i a<j x^mM^ifh -i 

C0048] m?L£. IUTT'vh •W>2-JrtWTH. dT\iX 

i o^iat ± . Hiii-r- 9 *m-~?) y - \<xi itim.iz 
m o s * - > "Ct -±4- < . W£ -< tztm.iz$> b «ii-r- 

jtttamre*tGfb*-£ tzmz . $BM s r-9t,nz9 tfi 
izx&mm c^m) izx -yx'&hzwtx** hm—om 

A • <y x. >V -ro^ni a [) xuzmmx'% h J: Ct£ 

[ 0 0 4 9 1 <4. 1 -JKfl^r^ffl^^SiJ^ljJcr/t 
3" 'J XO, >W.TT1i . 338 X -r ffiS I TIKI s £ 

3 'j x^tco v »r %<m? h , mztm s {c*< ssr x # 
•t-v h A&mm-z tm.a.LXo, ft^izz-?.. mm 

=r-9\- (y. yh ) *r. HM» <.X(4?#r>tO 
fc:f i v X fi-'J > ft * ft. 6 * * flKfeMS .h & ■ - > ^ 
rate-^-g. - SEtty h (i y 1 o^f^T"..?) o T . S^f 

ww^m&is-frm? 5X9 >j vr-mnmstwrnz. 

i ( s ) - i ( s ) 
= I i (s) -i* (s) 1 + I i 2 (s) 
- Aj- A,, 

[ 0 0 6 1 ] i ( s ) TkU-' i j ( s ) li^t'ASf: 
mnz&^xii'jmX'ch&J: )C. A^g^ii-^,/: 



[0050] 

[f!tl 2 ] i ( s ) =E ■ I L ( Y. 6 ( s ) ) I s I 
[005 1] ZZX'. El f (Y) I s)(i, S^s.tfJx 

mifzt*<omm$nmmxfoo. e (s)mm.s 

co-ay hn^f K (S'L-. «Mt0 T'^O^-C^^il 

[00523 
IS131 

6 (s) =argmin E [L (Y, yh) I s] 
yh 

[00 5 3 3 WMd ( s . y h ) (4. -It^.s -r^Li') 

> S > it«< L/C t S O) . |fflf#$i-t/cia*tC*3ft^«-C-^) 

[ 0 0 5 4 3 
[SI 4 3 

d ( s , y h ) = E I L ( Y , y h ) I s I - i ( s ) 
[ 00 5 5 3 «S| s lc:*fL T-frfilSrff ott- IZ&^X 

a. n^itt^i (s) rmmmci. ;ttxmt?*ti 

h i j ( s ) r . J flc7.)7*u < tc-5fSi|-rS I > (cj; T 
I 0 0 5 6 1 

mi 5 1 

Ij (s) =2p (x, I s) i (x,) 
j 

[ 00 5 73 I -T". x ji. 3 > -r^f X h7f(Sl^)7 r 

9 9Kmvi'i%?^mr£mxhb . vw* mis 
■> v-r ') -'ii-w\^mmmT^xm$tu> „ 

[ 0 0 5 8 3 
[141 6 3 

1. (s) = 2 p ( Sl |s) 1 (s k ) 
k=0.1 

[ 0 0 5 9 3 v >s . r< (cfe< 

[ 0 0 6 0 3 
I Wil 7 ] 



- i j < s ) I 

[ 0 0 6 2 ] 
mi 8] 

A 2 = Sp (x, | s) d (Xj, 6 (a (x,) ) ) 
J 

[ o o 6 3 ] .i?mz. 1 A^mwm^ti&crm 
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l xm^rz z t &*imx*$>& \ > t ■> o z t -r 

&tc#>co 1 x>-3— ^ i a ( xj) Tktf f fn-y i X 
\i±yhu4 K<9 (s K ) 

T\ xxn— K = 0. iraLt^ a ~f^> 3 y 
A K = ix.j: a (xj) =s K ! > LXfrM#^Hg"C?> 

X(i<? K'L*NL; (K*XI18 
1 Y. Li ride et a 1 . . "A n a 1 $=c o r 
i t hi rn f c;> r v e c t 6 r q u a n t i z e r 
d e s i # n " , I E E E T r a n s a c t i o n 
s o n C o iri in u n i c a t i o n , v o 1 . C C) 

a (xj ) < D + i ' r gm 1 n 
i 

[ 0 0 6 6 3 ZZX, i a r gm i n i l£3m«:M'HZ 

-tt i <7.m^^'tm%tTfo o . m 1 9 f ± k = 0,1 cot 

S/>|5l«(C, 1 a r Kin i n i {eft 
.1 T . ! a r * m a x i CO > £ (i . 3 l^riS^C^ £ i 

[ 0 0 6 7 ] 

[S2 0] A h ^- a (x^) ^i.i = ki 

[00 68] (2) k = 0. ] (-^fLX^U^rr-X 

[ 0 0 6 9 ] 
IS2 1 3 

e (s k ) lDr1 ' 

= argmin E [L (Y, 60 I s k ] 

= argmin £ p (x, I s k ) d (x,, 8) 
6 x,eAi <p + 1> 

coo? o i mmw^m^mw^m^zn i -c . >' a 
^^)JSfl^>7tfijr.;!. ^' i; XMi . rxts/p ( fiti£X 

it 1 9 1 A. N a d as et a 1 . . "A n i t 
e r a t i v e " f I i p — f 1 <:> p " a p p r o x 
i. rn a t i o n of t h e m ost 1 n f o r 
rn a t i v e s p 1 i t, i n t h e c o n s t . 
r u c t. i o n o f d e c i s i o n tree 
s " , P r o c e e d i n s o-f t h e I n t 
e r n a t i o n a 1 C o n f ere n c e o n A 
c o u s t i c S p e e c h a n d S i & n a 1 
P r o c e s s i n s , p p . 5 6 5 - 5 6 S . 19 
9 l*i (cj; ^Xl^*i\tzm$T)l'3\) XAtmkX 

[007 1 3 > v 3 *r cagR-saK 1 7 ) <±. ihws 

tz&bWMfrttrt*?- - 4 >^ry?X (Gini in d 

e x ) &imwtm. < .v T = ioo. ..oio... 

0 I ^yXM^iB^^ht^icmmmiCl 5rW3"SMfg 

0)9 yx-i r—9 ) wZ'Stsm^emvmmzj: 



M-2 8. pp. S4-9 5, 1 98 0*1 E i 

^) 'J >'f • 7'V — - XU Y (Li ride — Buzo — G 

r a. y ) <39T;l- =7 9 XA t WM-t&fcmTJl-a [) XA * 

[0064] ( 1 ) -S-x^C^rLX . mU^JZya—V 
a ( x^) ^J^aoftS, 

[0065] 

[»1 93 
d (x J( 6 (si) 

[0072] <4. 2 S^^^X«ffctrg^f^ffl>^ 
^ X 7f ffi^;) 7 7 X Li > XX)RfIS t BS L T . ye R.n( i 
K^^^ISHi^TX iJ jr— 3 > (CfiftS >"7X h 7 

9 . x(i j mmm-t >y h r .t 5 X^^ltl) -5 ( l?J 7l 
ti\ 2 6(®^)¥rfl^B*15^)#^mS, ) . Ss^ii. 
-W^flx/- ( s ) ac^^SttT^iJZ ( s ) (cJ: oTA?7X 
h'J -/7 - ^'WM^HMM^r/L-P (y | s ) rfg 

f/toT. -Wtfil.t±6' ( s ) - (jx ( s ) , E 
(s) ) (.J: T>-C^5fU», -1t«s(c^fi5^SX^)«Tfg 

m\^*th, SWU. A s - A 0 U A^fo&tMric . 

(zh6, 

I 0 0731SS. -^^rA-^'JXAtCOt*-Cl"a 
-TS h . ^^^fLTt^O^^MiPJI^-^ L ( y , 
8) (IS^'I^T-. d (s. 6) ?i6%Ifn- : f^|,o 

(Mit) X\ft6f$&l£. iS}liJ*r-^(.±. L ( y . 6 ) = 

- 1 o^p (y i &) >mrtztfix*h, r zvmm 
mtwijtxn. si 3LmrF^)XoizKch, 

[0074] 

e (s) " 

= a r gm i n E [L (Y, B) Is] 

= argmax E [log p (Y I 0) Is] 

a 

= argmax £ log p (y t I 0) 
0 t : x, 6A, 

[ 007 5 3 CCt. a2 2^35C(Ct3^»T. t : x 
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( 1 o r< p ( y t I # ) ) ^>fnrlt^^ k^rCift 

h, m*i^wmT~?frb?mLx& o inswap 

(y Is) *5fc»lTfc4fc*>fc:. Ci^iSlttfrfrffiS: 

d (s, 6) 
= E [L (Y, 5) I s ] - i 
= -£ log p (y, I 

t : x t € A a 
= (1/2) [N.loglZI 

-N 8 1 o g I S(s) I -S 
t : 

[0077]-:-:f, N £ (.i. 1Slsr¥l(,X{i:7-y 

[ 0 0 78 3 E33(C, E32c?)Xt- y 7'S 1 5tffli'»Si 

*-?(r*\LXlttc?)J: dlzmm-rWHl 3T £ , 
I 0 0 7 9 ] 
[S24] 

# f,;n { s 0 ) = 6> ( s ) = (/./.( s ) , X ( s ) ) 

X 1 ogp(y, I B"- Lt (: 
t : x t = X] 

C 0 0 8 2 3 Xr ••/ 7'S 2 5 "CY E ST^iUi". .Xt ■■/ 

T S 2 6 T-&#5S 7</t x ^ .) = 1 J (CtJ 

IT. -^-7x > - 3 >-A 0 -'Cx,rPJO^T. NOt 
/P>i'Ui\ Xf-//S2 7Tv*— -7 > a > A^HCx-j 

j xfohtj^frtmm^ti, Kt4i^?ii .x 

■7 •/ 7S 2 9 ? .j £ 1 /rff-M > 9 \) :A > h I 

t .x -7 ••/ 7° s 2 5 (cm o ±ia<7>?aa£$& o ii-r x -7 / 

7' ; S2StYESt^)S>J. Xr^7S30t\ 

2 tpi (s k ) 
= (l/N k )S S 
xj £A k (p) t : 

T"?>£,. 

[0084] N,(i ! t : x t -x,! Kfcft&S 

^)ST^>0. NoH-N^N^)^. ;^>T\ Xt--/ 
7*S 3 1 1 OMS&ktt-k IX ; s 7 > ^ >«flt 

>'tcMS A* . ^-f L L-^ V » > S fix 7" 7° S 3 2 T3S 2 
K^frh LT . <£crM2 9 Zffi^&frWfrfimm* 



(12) 




( s ) £-5-z_X ^&Zb ItZ'gmth , r/EoT. t2 it 

[0076] 
[«2 3] 



[ 0 0 8 5 ] 

CS2 9 ] ( L ^ -L l > l ' ; ) L'^<// CCT\ 
IfflLB 0 ] L*> = -N 0 losl 2^ ( s 0 ) i 
1 o % I X (p) ( Sl ) I 

[ o o s 6 ] zzx\ vim&mzmmztLtjiJ^fz 

C 0 0 8 7 ] 



(s) 

+ 2 logp (y t I Ms) ) 

t : x t €A, 
+ £ (y t -M) (y t -ii) 

t : x t eAs 
(y 1 -/i(s)) t S(s)- 1 (y t -/i(s))] 
c, eA 9 

[IS2 5] 

6^ ( Sl ) = (u(s) ( 1 + e ) t Z ( s ) ) 
[ 0 0 8 0 ] C^gi|^iMI.Pv(cJ; ot. 4/c¥vO 1 o^-7c 

^ f tsiait xnm *n h mmiz . -jm^rnnwTh 

ZtfMm^i'U^ 'fc\,->X\ X-7-/7 S 2 2^'^^ 
:^ p £2 1 //i"-b ■■/ h X-r •■/ 7'S 2 3 XW\ L I 7* 
■*V3> ! A,;^ 1 , A i 11 - ! (m^mzii, -ftWlZtLtz 
*mX'>h&, ) -kflrAth. -rlt. 77"/7' 3 S2 3t 
/ ^ x- j^ j (C 1 ^-tr •■/ N L . X-7 7°S 2 5 t;^)S 
2 6 v J7?^r -^yi ^7^JI*7t ^ i l 

[ 0 0 8 1 ] 

[S2 6] 

i 0 ))S2 1 ogp(y, I <9^- i; ( Sl )) 
t : Xi = xj 

m*&ttw^x—n&m£iiZ£^^> hnj k :^ 

(t " ( s K ) - (/^^ ( s K ) . ( s K ) ) : K = 

o. i ; *<tt$:m^xnm't&, 

{ 0 0 8 3 ] 
[S27] 

M l0y (s k ) = (1/N k ) 2 y, 

t : x, EAt (p) 

[S281 



(y t -w CD) (s k ))(y t -xz Cp) (s k )) t 
x, =x, 
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(S3 2 3 

S, 1 (s) =2 y, 

t : Xi=x,, Si = s 

[«3 3 1 

S,* (s) = 2 y,y,' 

t : x i = x , , s t = s 

max-—. mmzix. atN^sc^ t >j iztmzn 

X v > h TIEtfV "? 5/77 -C'(i - 3-iHW-r * h ( » 2 

ffl^ffi**L-C^-5- -Lit. Jf. STffJ-r.Xh m 
2 6 ) SJSSR-*-* £ t (cot, >-CfiWr& , 
[00923 
[Sfe3 4] 



im.3 1 3 L w SL l > !i 

[ 0 0 S S 3 A-r •■/ 7*S 3 2X\ »2 9 ^fflJ£-^4^ij> 
(f. .*-f >7L— f-/(Cl'). — ?T. S2 9.fc)»£L-5rV* 
Xf y/S 3 3tv<7^-^ p *■ 1 f3fJ V? 
'J X > hit ?- -r ■■/ 7' S 2 3 (CM ') ±iE?)9figi£ jR 

[00891 UZTilzfVX^crmfWMzttlXli. $> 

X 0 b-H«r*Sifa£te -5tf-?f^t.: 1 «t Oft 

saas*:*^* c t & . mz. ttmt& 
&%®iximhm&& xjz&^xn i-x . ttisicH 

-wT". N i {.±X=x, i 2rWr-g»-1tS|.s(Cfc(t^^> 
7"/U ( 7U-A) S'r^^^^-r^., &LX . itt?) 
X r) ic . l tf&y 2 iT^llMr IeSI-^S 
[ 0 0 9 0 3 

2N.log I 2(s„) I + 2 (yt-^Cso))' S(so)-'(y, -m(so)) 
t : x, =x, 

g2N,log| 2( Sl ) I + 2 (y,-M(s 1 ))'S(s 1 )- 1 (y,-M(s 1 )) 
t : x t =x j 

[ 0 0 9 3 3 ie^&2rfS'iii-ftr6/c*'x SftlU^sr^^r 5»U :) lzffimfrt& ■! t VX'~ h . 

±.tt$?)adft ( p ) .*:«BfW6 .. ^f0<7)ii(± . ffc 3 2S [00943 

tm3 3izj: i )5-t'UU>mm?:Vim-rz.f^. i-xt mssi 

2 (y,-/t (s 0 ) ) '2 (s„) (y, — jti ( s o) ) 
t : x t — x ] 

= 2 tr [(y,-« (s,)) (y« -tf (so) ) 1 2 (s.) "] 
t : x, =x ( 

= tr[ 2 iVi-u (s 0 ) ) (y, -ti (so) ) ' 2 (s 0 ) "»] 
t : x , — x, 

= tr[2(y,y t , -y, M (so) , -M(so)y. , +u(so)/i(s 0) t)2(s 0 ) _1 ] 
t : x, = Xj 

= tr[(S, 3 -S, 1 w(s 0 )' -/x(so)(S 1 1 ) 1 + N, jti(so)M(s„) , )2(s 0 )- 1 ] 
[ 009 5 3 ZZX'. H^xtz»A z = t r ( z z ^rUstt i OT^Oii ») X'$> & . 

t a ) . Tkmwmm, r < • > # 1 asia^-cft* t [ o o 9 s 3 

^ 3 *3g£ fiEFS l*-.. .1 it <b<75&» 3 4 
[ 0 0 9 6 3 

[©3 6 3 2N.il os I E(s 0 ) I +tr f ( S/-2 Sy«(s 
n)«+N i «(s 0 )/x(s 0 )«)Z(So)- l )S2N i loR I Z(s,) 

I +trl ( S/-2S.Jw ( s^'+N.ijut s,) /.'.( s^*) 
2( s,)-ij 

[0097] ^'rt*£m\m.*&mth>^*-9miL'm. 

2 (s k ) 

= (l/N k ) 2 2 (y,-tt( 8k )) (y.-M(s l ))' 

Xj e A k t : x, = Xj 
= (1/N k )2 2 (y,y. , -y,u(s k ) , -<i(s l )y l , +M(s l )a(s k )') 

X| GAi t : x i = X| 
= (1/N t )2 (Sj^S, 1 wUV-uUXS,*)' +N, tt(s l )M(s k ) , ) 
x, e A k 

[0099J KJBrrZ. I- . RW <5X—?m&&if&l ettfiii. h infmftmi'$>i>b ES^«i«f ffi*ft? 



[¥?3 7 3 

M (s k ) 

= (1/N k ) 2 2 y, . 

x j ^ At t ! x t = x j 
= (1/N t ) £ Sj 1 (s) 

Xj e A k 
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[0100] 

M 

log I 21= £ 1 oga„ 2 
m= 1 

[»40] 



M 

t r (ZaZ," 1 ) = Z o».=Vct... 2 
m= 1 

[01011 ficof . »L v >S^f"l-r.x HiWTcoJ; :? 

[0102] 
[«4 1 ] 



[f*4 2] 



C„ + Z [S 1 , G 2 (s)-2S J , o 1 (s)/i o (s 0 ) + N 1 ^,(s,) 2 ] /o„ ! (s,) 
m 

^d+2 [S j ., J (s)-2S i . 1 1 (s)» 1 (s 1 )+N l ^(s^M /o, 2 (sx) 
m 

l . m 3 s« ±;-J3Cw J: -» cfsm fi:5^t§ . 

[ 0 1 0 4 ] 
[fU 3 ] 



2S,.. 1 m. (s k ) +N, lit (s k ) 2 ) 



C k = N, 1 og (na. 1 (sj ) 
m 

[oio3] tfz. &ftMfTziwmftmiX'$>&t. <m 

o a < (s k ) 
= (1/N t ) Z (S,,. ! - 
xj e Ai 

m-i-i] 

o B ' (s k ) 

= u. (si) * + (1/N k ) E (S,.. 2 -2 S,.. 1 tin (si) ) 

Xj eA k 



zzx. ni= i m -<:■•#>&, 

[ 0 1 0 5 3 .If)7n.iijXi,r. t".?t" • Til 3[)X 

i^xn%<.>^-i, ■ ^ 3->i+?)?mTii 3 

& frjg. & -;em-: lot. mics 3 2 s.tq& 3 3 

; ( s ) -r B#R3 1 CO t 5 c7)-1tsj.'r s X'fc &kt> ammz 

nm**t&, z<7)tz. mi^ ^TtKcmmiii'RjKxm 

1 0 1 0 6 ] 

[$C4 5 ] 

S, 1 (s) = Z r. (s) y, 
t : Xi = x, 

IS46I 

S,« (s) = Z 7. (s) y,y,' 
t : x, =xj 

IS4 7] 

N, (s) = Z r, (s) 
t : x, =x, 

[0107] r t ( s ) Jfti. mTPJS 5.C' : 'M-[6]?-'^^ 

11 SS S&Rt/S I — S S S&dfcttSAN— A • <7x 
/I * £>f0 WFl&X'fo h if . S S S j£(c{±.- am 

mzi£xmft^&fz&aj?-?mmi)' i Ki:< . si-ss 



sffi*)f$&{ iNx^ftflo^S^WAft & s s sire 
{ i , •frMcj&isr y - 1- . ay y - k //'^te * * ro > § 

( s ) aym&iiZmb Law ~ii.fi. ^Si|(cft,S4-y- 

< lm (*1 * T yt- of' 'J XA * fSffl-r & tzfrX'h h , 
[ 0 1 0 8 ] < 5 . B#r B ^-fij£0SiJ^o* HM»)«> 

h m mo^mzio if zftiammii. mm s tvz -t - 

-kiZ&xma*it$>Z}iX$>&.. ±i&7)J: o 

(C. SH^O^EM <»Jf#lfi-*fcttI) TA-zf>JX2+a)-X 

ix&ittita)tmnmi)K nfcX'-bm-frmmk 2-jami 

\*">W&)mfr*ix&1t&amizm&%:\,->t v> 0 ha>xfo 
h , mi-rh 2 'jaftm.nitm ±fa-> y. * KiTc^-m^) 

mkaynfawizfflfflrrz zta. -t^ti^mx'^ s , 
[0109] *miffima)s s smztii->x . mmn^ 

$it^m^t^J4fc^^^)t ( r t ( s ) : B#re1t 
lz*>tf&*ms axfcM) aj^E^ts, zaM&. 

h^t&mLth x 0 iznm-r^imij^ , x* &m 
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oAhiizmax. m<7Am<7)itmK mrs-x^frmiz 

|tn#> o > <"f T .X tc h Xfo h o * 
[0110] EMSKj. B5fil^rrpic0*iijc7)|ft 

i ± - » mat w ^ ^ - ? «ege 

mz^x^\tLKc^b^omm^hh, x ogwrtr 
& fzMz . m5<r)3Lo icim s * z-frm $ ixtzi-mt 

I . Am. q q i & ft<7>fr pj(c J: -> x % bix h 

2-ocrrtamt'*&, <itxb?mt%*:£ wmnz^&tz 
s * tsfa-rs* m i i ^m^m-t^ tzMzmm i & 

( q 0 ) . V ( q 0 ) , .u ( q t ) . G ( q J . u 

(qi) I T'V?>£, d?*, .a (q) {.±^. ci (7)^(1 

^h/l't?)0, a (q) v 

( q ) {±-1fc®q//»*V1t fi J.q^Ofl , JS5I^. "f 3 ^:^. 4 - 

o L £z* <y^— 9 0)Mf^mS] L- . fl!l( ±SS8 1 ^ > >: o :j 

^m^htz^zit, dt£mm>£^x\h?:> , 

[0111] 

IS4S] r t <s*) =r t ( q 0 ) rr t U^) 
5 1 ( q * q ) 

= p ( q t = q , q t _i= q i Y ) 

= p ( q , = q , q t-1 = q " , s , = S * . 

= 5 h t ( q , q ' ) = t ( s * . S * ) 

[0114] iBr t l:> ( q ) Mf£ tb(q, q * ) 

(i. rt <s*) >0t-v5-&7 i "— ^^$:(5fflL . 
r t. b ( q o ) + ?- 1 h ( q ! ) = l > J: :> KclfMxi 
q i iztt I X <n^<m Mf a-1*®.*S ; r 1f-f £ M fa £ 

KH-ftL. tL-<t±. i6^A-vf> ?m'rt> LXm*iX 
Mo (q) 

= {S r h t (q) Tt (s *) y,..} 
t 

[t57] 

a 0 (q) 

= {Er h t (q) Tl (s *)y, iB , }/{S 
t t 

[3S5S] 

v (q) 

= {2§h t (q,q)g t (s*,s *)}/{Z 
t q 

[01163 Z ZXlSM-i-^ -1 tii. mr t b ( q ) 

Rvs t b •( q , q ■ ) <r£mizmm*ix&m\*\* -tk 



{%14 9 1 S t ( s * . s * ) =5 t ( q 0 . q 0 ) 

( q i , q o ) + 5 1 ( q i , q i ) 

[S5 0] r t ( i ) = P (s t =i I Y) 
[»5 1 ] 

5 t ( i ■ J ) = p ( s t = i . s t _i= J I Y) 
[0112];^'. ±S^(±HiMIVIc7)S1tTE(C^ 

Kc—m^mx^ n . Ya-t^X 0y¥S*: ■•/ h S:« L T 

[0113] 
[S5 2 3 

?' h t ( q ) = t:> ( q r , = (: 1 I S t = S * , Y ) 
[ 3& 5 3 ] S h t ( <:i . q ' ) = P ( q t = <:| , q t _ t = 
q ' I S t =S*. S -_i = s * . Y ) 

[S5 4 3 

( q ) 

= p ( q r = q | ) 

= |D ( q t — q , S ♦ : = S -i- I Y ) 

== ?" h t ( q ) ?' t ( S * ) 

[S551 



s * | Y ) 



^h t (q. q- ) ^mm^^ynw\^znix%m'th 

t * tffl t -r- ? i I . -1 -1 X\ m 6 (Cfc 

b ( q ) t b ( q . q ' ) mm$txhb . <m 

[01153 
CS5 6 3 



/ (Zrh, (q) Tl (s *) } 
t 



rh t (q)rt(s*)-/xm(q) 2 } 



£ £ hi (q\ q) S, (s *. s *>} 
' t 
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[01173 m^foftW$llZJ;&HMM^lZi5tt& 
S<7)KSE#^ \*X*X>& > SI-SSSSICJ: ^B#PbW 

ixX ^ * h & . 1 o^#jS^ 2 0^)frl^/\^)7f SWCfo t > 
Tti, *JJBF«'>L3:V ^ fc 2:SIiFf-£ J; 3 <c#MIS^ 

-rs -i t wTt* *c\, \, z^mmzm xmm i x t 

w&*mirt&lcox*£>&* mmzu. zixxufoh-fr 
mzitm&m'jH ±£ t & , z . *<?y^smmn 
w^y^mm^^zmm^i^ \ ss s^)^^ 
#iUT/i rr 'j h mmwmMitmz- x^& , zrat . 
ti*7 x ft^mw- * txti-t h mizmm<vmwTm<7>ft 

cry-ftm s w izmm i x mt 3 tuz t <r> x\ \ c 

./ - )-n^mmm^mizm^ x . seetotssitdH 

i^:^^i'J?iio^. lawiss si£^)r/L =?"<; x 

r^^SIIlKr^T-r^ ^ fc C J; -> X . S I - S S S 

s i - s s smfrwmzm<>*—& • ^x.^ wmtm. 
mmzti \, xwm<7MMm£*im(z ix v ^ ^wj) 
oteot. &mmzn. s i-sssscjsirsiBrar 

[0118] <6 . -4=^ffJ®^^#^i£#3iSg#^I2. 

tffg^E-r/L -fc •■/ N >: L tHMi 1 1 trfSffl L-T t , . 
mmMM 1 1 (i^H^^^$fi^#^?l^fj?c#^-r- 
>lX\h& , 1 O^HMili^jfi^l^tfil's: 
H MM 1 1 ri^^X^ffi^^ti'^cO^r 

ix h , Z o J )fitfy sy;A — 9 &W?)tzfo<7) -r— Wlfj ^ P 

^)HM¥B1 Hi, fiEStf^J^) S S S b&LW ? it/> S I 
-SSSi££ffivvC@ifl£0E5#U>, ±MiS I - SSS 
?£T1iHMJHl l<Dbtfnis—<ryMJB. mM?yxaM 



(16) 
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ra^icfi 1 ^ o , ^mmmiztoi xn . h mjb i 1 ^ 
n?*—?t ix. tf*xftwxmm*ix&itiiimm%. 

yMIW^^fl) , <7)/^:^>l2HB#tC(± — H M M 
tfflmiZiJko<ltfrX$&, ±!2HMffll 1^ 

SSS-LR (left-to-right rishtmostM) 

^wim^mmiMmimmmiic^ xnm'rh, 
mmmwte . * * >j ^ts^^it^ hmii i t max 

[0119] ilfcfc^t. fS#^)^#^{±-?'-f 

* >• i $itr^ft^-c^t$it^. »tK 

gB2(c7^3it^, ?tffiMi±}gB2(.±. 7^3it^^fl 

"DSSai/rf£. f?i|>i(i:LPC^ff'r^TL. *T 
S^ r 7-. i iy^yrxh^Li^wi. Attl/^^M 
1 6^A >"7\X b 7MMt$:-£t£ 3 4;jC7t:^fi^ ^v,^ 

V< -y 7r.^ Li 3 Zft L *C#^^4 (l/.il -3ilS , 
[012 0 ] #^fiS'^gP4 H MJB 1 1 it. 

ix . , 
( a ) 

( b ) ^S^TI^a > 't^X h 7 

( c ) Ttffltl. M'MW)'Jxh 

( ci ) \^inmm^WTt^y'<yy-9 

[0121] ^B3'^4(±. >f^74^S 

■^Erai^iO-r'- 9 KzM-th itm^m *ix . C ^.)#:rt^) 
fI* i- #^fl3'&.X 3 T £ I X L R ) <-*f 5 Cil ? it h ■ Z 
oyct^Z^^ : Axh^Mt. HMMt#IItl)StA 

, *«^tf-s:tcMii^) h m m xm ^ UXX V -i § Mra 

[0122] — ^MatiXa-r— X2 0^) 

F/f7i^)xi;g*"3ta; ( c f g ) ?im?mn mmiz^z 

m L X L R -7— 771- 1 3 ££0t L T vrA » J (CfSS*! 3 
ixh, LR.^'— »f" 5(±. ±IELR-r— 3r#. H RL 

('Z^ ^M^uzm^-th, m^mzhv^v^f^ht 
mm t . x ^ v .? sr jfiy l r -t'<x ^mm^nmf/^r 

lXmM$ix&, LR.^-f5li. LRf-'/./l 1 3//* 
4(CtH?J-r-&, CitiCJc^fc. ^SB3^4«a, x<7) 

mzicttm-r &HMM1 1 w>ifig^#H3LrB3^L . 

-f iO^tfg 5r ^ISMX 3T> L T L R^ f 5 (CM L - 

m&Mm*:mmix^< zticx n . imM^fflm* 
rr^\ ;c<7mmzm£^-9*\ti^h, ±mmm 
^mmiz^x. wk^^m^m *ixtzm&\± . z 
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0 mm o * firo xmrnm? m%* s , 

[ 0 1 2 3 3 WJi^ffiflg®tcfcv ?#i»*fcit!SB2 
> . ffiB»&3K4 £ . L R> ^-*f 5 i: . T^teIS^-t 

mi It Itffir— X 2 0 > L R-r— 77L- 

1 3 fc#fSW3ix6#;* ^ 'J i: A-y 7 r.x ^ 'J 3 fci±. 
PRUT; v- Kf^^t'J T-fllScSiiS rt 

[0 124] 

<7. ^>^isM?ytii. xmmffi&s i-sss 

sawco i ->T!CT-r& , ?eat fig s l £ -> uicov* 
xmmttzm. m&±if^wizn^&^mm^m3. 

m^i'itc tzizm^ ^ixtzmm&ttm&Tfo o . mm 

(zm'ffl Zilfz 3-y vX-cti S [ - S S Sife^M* L J: o 
b I "O > & 9 >f 7^;fa1M£ Wi^- t >/>#>{C . S I - s s 

s mz t o xi m t n l v > -r x t t ^ o r t -> h , > 
x\ m^(^smx\t^^i^trm^wmmzx n&^9 

9 x 9 corns. * ?t o /tfsmd o v *x mm* & . 

[ 0 1 2 5 3 < 7 . 1 ftP^^i>*#«)@W 

hzt. mm$^^mim&wmmz& 1 rc«re&5: 

£v *BB4fei?/rlSf*-rS -I >: tl>S - .^BflSr^B L tzb 
£ (Z"IniiX\h r> tzW^'&pS'T— 9 SLfj v -' A * ^ x /I- * 
cWBTA n 'J £ ttffi-r4^»fc:J«H- frT\?> o ?t 

. a « (i^^;)i^A±(f^^(.cw i xmmm=t -r 

>L £^m*tL ^#^(c^LT<7 h'lm^ffiit^m 
^'*X^?y£ J rtl-$:m&{k'*& •- > tea? rlf*, 
[ 0 1 263 £ft6<03BMcU;. ffltfflos-yv* (w 
l§«*4 ) £ fSffl L-?t . m^rii^mm <«S#l-2*> 
(cfc(t^v1^®^h^n>—^> . fg^fift?S^ (IS 
* 6 £ ) Tti . S t ft SH^lt ■» 5 2 4 0 i&IS ( A -fc 
•y h) B*15 

.^7x11 ^^:7^/U0> — ^>'X> . &^^-tX.;<> h 

izn*&fmk*t mT*t & n i >r 5 r-« § ¥ s < x 

L , ^{.± . f&y XTT*rn^f£^fc J; ') ^ 

( C-tz •/ b : 1 5«^)l£#/; i *5 O^Sr^leffi 
tt L.3t5«5:S5:6«iSiSS'C' 3 E«S L-f t ^ , ) oy 

(i . A-b ■:/ h t PI C 7*^-7 -f ^ D,t >* 

SrffifflL-fe. .-K-X#E[ (»iL#{a) (4*»&t'-e-^ 
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A-fe-yhfcC-fc-vh3-y«fc:BBLT{±. tJSRXK 

2 0 ! A . Kure m atsu et a 1 . . "AT 
R J a panese s p e e c Vi d a t a b a s 
e as a tool of speech re 

0 s n i t i o n and synthesis", S 
peech Com muni cat ion. 9 : 3 57 — 

3 6 3. 1990$i (C&l ^TlttHflSilT OS . ftf* 

ms^zj-jixzmmix . ^mmexmmm 
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